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ABSTRACT ^ ^ , 

The sequences of learning sets (intersequence) and 
instructional events (intrasequence) were eipirically validated for a 
hierarchy of concept and rule using skills. Experiments with high 
school students showed no differences Between enpirical and reordered 
inter- or intrasequence on %ime to "master yj nor was there a , 
difference in the nunber of skills mastered between the empirical and 
reordered intersequence groups. The data suggest the use of examples 
allowed learners to acquire higher-order skills even though they did 
not at the same time demonstrate mastery of subordinate skills. 
Effectiveness of the instruction iTidicates that the events included 
are more critical than their sequence. (Author) 
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» 

The sequences of learning sets (inter-sequence) and instructional events 
•^Xintra-sequence) were empirically validated % a hierarchy of concept and 

rule,using skills. Experiments with high school students showed no 
• differences between empirical and reordered inter or intra-scquences on 
time to mastery; nor was there a difference in the number of skills, 
mastered between the empirical and reordered inter-sequence groups. The 
data suggest the use of example!^ allowed learners to acquire higher-order 
skills even though they 'did not at the same time demonstrate mastery of 
subordinate skills. Effectiveness of the instruction indicates that the 
events included are more critical than their sequence. 



Introduction 



Inter-sequence . Hny^ne describes the concern of his book The Conditions of Learn 
Ing (1970a) as tKat of finding an answer to the question. \<Jhat is learning? 
The answer is phrased mainly in term^of "an objective description of^ 
the conditions under which learning takes place (p. 3)." It is Tiagne s 
position that learning is very much dependent on the conditions which 
a^ompany it, and that discernment of these conditions .and arranging 
for their occurrence facilitates the learning process. 

Gagne describes two types of conditions of learning, conditions^ internal 
to the learner, and those external to him. Internal conditions are those 
capabilities, or learning sets, which are already in the learner s repertoire. 
To be sure, -most of a learner's capabilities are not relevant to a particular 
instance of learning, but some are. Take for example .rrhlld wl>o is attrmpi- 
Ing for the fir-sL time to learn o<l«»IHon of two Inl 1" Inns with t«lm 

to lUo situation a number of relevant capabiUl fcs, s.>< l> .'m .hI.IIhk wly.li' num- 
bers. Identifying numerals, use of associative and ,i v)inniuL.il I vt- properi U's, and 
so on. It is hypothesized by Gagne that all of. these capabilities, or in- 
tellectual skills, will be used to facilitate the learning of other higher- 
order skills, such as the adding of integers. By examining the relations of 
learning tasks, Gagne concluded that learning is cumulative. Each capability 
is . used in learning a new skill, which is in turn used in the learning of yet 
another. 

- .A hierarchy can be cbnstructed which illustrates the dependent and inde- 
pendeKt relationships between these learning sets. The construction begins 
by examining the terminal task and asking the question, "What wpxiU the learner 
have to know how to do in order to achie^/e successful performance of this class 
of tasks, assuming he -we^^e given only instructions?" This process of task 
analysis is continued" for each of -the identified skills until a level of basic 
competencies is obtained. 

Such a hlerarrhv serves to imply a soquonco lor llu> prosontat Ion" of insl ru 
tlonal materials to the lonruer. He should first U-arM a.w proroqu is I skill 
which he lacks before beRinning instruction on a.hirju-r order skill. liv 
hierarchy "also denotes when the^ sequencing can be random ivr optional. Instruc- 
tion for two or more skills prerequisite. to common higher-level skill 
could be presented in optional chronological order. HoweVer, instruction for 
all of the prerequisite skills should be presented before instruction for the 
higher-level -skill. 

Such a hierarchy was constructed by Gagne, Mayor. Garstens, & Paradist 
(1962). for a terminal task of adding integers and is reproduced in Figurr- 
1,^ Each box in the diagram represents one" of the skills in the hierarchy. 
The skills at the base of the hierarchy are subordinate to the skills directly 
above them. Gagne contends that the lower order skills facilitate the learn- 
ine of the' higher order, or superordinate skills. Ledrners who do not have 
one or^more of those subordinate capabiliries will have difficulty learning 
the adjacent superordinate skill. ^ 

In this and similar studies (Gagne and Bassler, 1963. Gagne and Paradise, 
1961; and- Gagne and Staff, 1965) Gagne examined th«- pass-fall patterns of 
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FIGURE !• A curricultin hierarchy on the addition of integers*. 
(FronGagn^, R.M., Mayor, J.R . Garsten? , H.L*, & Paradise, 11. 
Factors In acquiring knowledge of a mathematical task. Psychol ♦ 
Monogr.» 1962, 76, WhaJle No/ 526-) 



the learners who had received proRratnmed' instruct ion on each skill in the 
hierarchy after completion of instruction. Based on their patterns , ^ / 
of pass-fail. for each learning set the Ss were divided into four groups: / 

* ' • ' / 

1) those successful at the tests of a skill and all its subordinate skill 

2) those unsuccessful at the' test of a skill and at .the test of at least| 
one of its subordinate -skills; • 

3) those -successful at the test of a skill and unsuccessful at the test 
of at least one of its subordinate skills; 

A) those unsuccessful ^t tha test of a skill and successful at the 
tests of all its subordinate skills. 

[n each of the studies the number of Ss who learnod the higher-order skllLsf 
without acquiring .the lowdr order skills (group 'i) was very small. Gagne / 
used these data to support his contention that learning is cumulative. / 

In a I9^2^study Gagne developed a hierarchy wirli the tennlnal^^taHk ol • 
"finding formulas for. the set pf n 'terms in a number scries." Test" itomii 
for each learning setp in the hierarchy were administered to seven .ninth ; 
grade boys". '|!ach boy was tested first for. the terminal skill and,, if , . '. 
'he failed received the test for a subordinate learning set, and so on until 
the boy passed on a learning set. At this 'point the testing was. temporarily 
stopped and each boy received programmed instruction for the next highest 
learning set (^&hich was previously failed). When instruction was completed 
the Ss received test items for all competencies in the hierarchy. Th^re were 
no Instances in which a learner passed a higher order skill without ^so 
passing ajl lower level skills. ^ 

However, in reviewing the theory and results of these studies Anderson 
(1967) states that none of tha results from the above studies ^' 

proves that" one concept of skill must^be mastered before the /next one 
can be learned. " Since topics 'in the program wore ordered frybm the 
lowest level to the highest level, any factor ihat caused a- subject, to 
"tune out" at any point within the. program could >v?ve firodt/<'ed the posi- 
test results that were obtained. Direct exper Imimtal manl/Suiatlon of th« 
• , instruction designed to teach subordinate knowledges, ratl/er lUan post- 
experimental correlation analysis, will be necessary tb clinch the 
argument. (pp. 157-158). L 

" Merrill (1965) also examined the necessity of requiring/mastery of 
subordinate skills before learning superordinate skills. A /complex science 
'system called Xenograde was creatied for use in the study. It was hypothe- 
•sized that learning of this Thierarchical task is facilitate by metering 
each successive part of the material before proceeding to the next. Sixty- 
two college students were assigned to five groups which w^re given various 
level tasks. The results contradicted 'the hypothesis. The group which 
performed best was not required to master all the skills but received a 
summary of each lesson prior to the review exercise which preceded the 
test. The groups which received the most correction/review took progressively 



more time but did 'not make fewer .mistakes. Merrill concluded his stu4y by 
saying that. "The results seem to findicate that it is not necessary to master 
one level "before proceeding to the next (p. .233)." 

BriRgs (1967) rebutted Merrill's conclusion by contending that he "wont ' 
beyond his own data in interpreting his task as hierarchical (p.' 66>." 
•Brdggs also felt that the experiment was more a test of, the ef fectlvt?noss i>i 
varying degrees of review on learning, rather tiian the necessity to master 
subordinate skills. Such comments indicate that 'results ^obtained in tht 
Merrill study may be due more to methodological error than to the lack of 
need for mastery of subordinate skills. 

In regards to Anderson's statement concerning the weakness of tho cor- 
relational design of Gagne's studies. Briggs notes that the 1962 study wi-nl 
beyond mere post-experimental correlational Analysis to include instructional 
manipulations of the Ss. Briggs did cdncede/that even this study did have some 
methodological weaknesses And he recommended an alternative design to test 
the assumption of cumulative learning and the effects of hierarchical se- 
quencing. The design would require (p. -7): 

1. the derivation of an inferred structure or hierarchy by analyzing • 
. the objectives of the course; 

2. sequencing phe units of instruct in accordance with the inf-erred 
structure; 

3. testing the "optimal" sequence gainst a random or reordered .sequence. 

Related resparch . liany studies in recent years have examined the issue 
of "logical" versus reordered sequencing using .the«hlerarchical approach 
recommended by Gagne. Of those that have, five (Boston. 1970i Brown. 19/0, 
Caruso & Resnirk. 1971; Resnick. Siegel.'& Kresh. 1970; and Eustace, 19fv9) 
have shown differences favoring the hierarchical ^si'quence. where six- (Kane, 
1971- Niedermeyer, Brown, & Sulzen. " 1969; Oliver. 1971; Pano. 1972; 
PhiUips and Kane. 1972; and Spencer. L971) show no differences. 

Boston (1970) hypothesized that more students lollowing an empirically 
validated sequence of learning sets master the terminal task than students 
following a reordered sequence. He also hypothesized that students following 
a reordered sequence take longer to maste* the skills. Boston developed 
and empirically validated a hierarchy and instruction for a concept of 
"redness". Computed tests comparing the effect of ordered and reordered 
sequences on time to mastery on each learning set produced a trend^of sig-^ 
nificant results supporting the favorable effects of the -hierarchical se- 
quence. Results also showed a larger number of the ordered sequence group 
r!.r.stered each task. . 

Brfewn (1970) examined the effects of logical versus scrambler! frame onl^r 
with an improved version of the Number Series program. This program was 
used to teach 67 higWbility eleventh grade students the necessary learn- 
ing sets nrerequisite to a mathematical problem solving task. The logical 
sequence group performed better than the scrambled frame sequence group • , 
relative to time to complete the instructional prof',ran. errors madt; on \hv. 
program and errors made on a criterion test of complex, problem solving 
nuciber series skills. 



Carufio and "Resnick (1971) trained flfy-five kindergarten children on 
watrix tasks inyolvinR color and ^hapei The subjects were divide^, into 
four Rroupsf t) trained In the hypothesized optimal sequence; 2) trained 
on the same tasks in the revere sequence; .3) given overtraining on the 
^simplest task followed imrtediately by training on the most- complex task; 
and 4) trained to criterion (without overtraining) on the simplest task 
followed immediately by training on the' most complex task. Mor»€ subjects 
learned the mobt complex tartk .id they learned in fewer trials, when / 
tauRht in- the optimal order. subject learned .i l>l I'hor-order lask without 

also havlUR learned the lower- level «me, 

A hierarchy 'of sklltH t or a lermlnnl Lank -Invo I v hi)* I In- i-nmpli-x ( i»iu i-|»l 
of "noun" was developed by Eustace (1969). It w.ik hypolheH IzimI Lli.il in .i 
hierarchical task directed tot ard the learn inp, of a concept, more learning 
occurs when the levels of the complex material are -presented in an ordered 
sequence. Fpur experimental groups were given the program in varying 
degrees of order of the sequence 'of. learni,ng sets. An. analysis of variance 
tests for linear trend using the means of the residual gain scores for each 
treatment group was significant at the .05 level.. The analysis indicated 
that as the sequence was progressively, reordered, ,mean scores were lower. 

Resnicki Slegel, and Kresh (1970.)" trained twenty-seven kindergarten child 
ren on two different double classification matrix tasks. One group of 
students received instruction in the "optimal" sequence, the other students ^ 
received instruction in the reversed sequence. Those who learned the tasks 
in the optimal ordei^ learnfed the moife complex task in fewer trials than" those 
who learned the tasks in the reverse order. In addition, students 
in the reverse order Rroup who did acquire. the hi j'.her-ordfr skill fj^owed 
evidence of havlnp, acquired the slmpl«T task in tlu-. prfucHs. 

Kane (1971), and Phillips and Kane (1972). rrporlln}-. o" « l>c s.inu- ;;l udy 
compared seven different sequences-of a mathomhttcnl task derived by 
xlifferent means. The original sequence was constructed throug^j task 
analysis and the inst'ruction was empirically validated. Pilot test data 
was reanalyzed to produce six more sequences. The ^even types of sequences - 
were": 1) task analyzed, 2) Guttman scaling, 3). random, 4) item difficulty, 
5) correlation, 6) textbook,. 7) AAAR method. One hundred and seventy- ' 
five grade school children participated in 'the experiment. Two pretests 
were given to the students. Pretest I indicated whether th^ children had 
the necessary prerequisites; while Pretest II was designed to determine if 
the students had already mstered the skills to be taught by the iyistruction. 
Those learners who passed Pretest I were' given Pretest II. The • st^bjects 
who were judged to have mastered an Insignificant number oi. skills on Pre- 
test II were involved in the experiment. The sequence derived frdra task 
analysis was reordered for each method and giveh to groups of cHilldren..^ 
The researchers examined the effects of sequence on achievement, rletentton, 
transfer and time on task. . A one way analysis of variance for eadh de- 
pendent variable showed no overaljl differences betwec'n the varlouH sequoi)ri.s. 
However, the task analysis sequence did require Itss time to complete than 
ythe correlational sequence. . The researchers concluded that no sefjiusnce 
.maximally facilitated achievement, retention, and transfer and rec|uire<l less 
time to complete. , " ; ^ 



■ li. ' \ . . ' ■ • 

Mijt should be noted that in the Kane (1971) and Pl^llips and Kane (1922) « 
studies none of the dependent vatiables were concerned with the number of learner 
who mastered- the tertainal task. The importance of the distinction between 
achievement 'and mastery is discussed in the following section on methodology. « 

Niedermeyer. Brown, & Sulzen (1969) used the program, Number Series > . 
developed by Gagncand Brown (1961). The program was presented to 64 ninth 
i»rade students in logical, -scrambled, and revefse orders. While^ the logical • » 
oT;der group was the only sequence group to perform significantly better ' » 
than the controls oh' both a test of co-hcepts and a problem solving test, 
•none of the three sequence groups differed from each other on post test per- 
formance. Since the program' was developed by Cagne it was assumed t>*? . 
hierarchical. Niedcrmeyer (1.968, p. 307), however, observed, ^ i hat "The . 
Number Series -program must have been {jfleve loped pr lor to C.jgne's di-r Iv.ii ion 
of this knowledge hierarchy since little rorrospon.loiu-.- roiild ho I •)un.l^ 
between the frames of the learning program .ind tlio i.isks uloiuiliod In 
hierarchy."* Tt would appear that the. I^iedermevcr > ot al . study <J"ld luU pro- 
vide a valid test of hierarchies sequencing. 

oiiver' (1971) developed an index t^ich can be used to determine the ^ 
degree to \Aich a sequence cons°tructed by the learner. is reordered from 
the logical form of that sequence. This index enabled him to conduct an 
experiment in which learners were allowed to determine their own sequences 
and compare the effects of the degree of reordering on learning. The 
Xenoerade .Program (Merrill, 1965) was used in the study. Oliver found that 
not only was learning not progressively impeded by progressively reordered 
sequences, but that there was no difference of effect betweeti the logical 
sequence and the set of all Reordered sequences. Oliver noted that those 
students who -Scored higher on a test of the basic ability of Induction 
were affected less by the reordering. However, Oliver failed to demonstvato 
that the instruction used in the experiment was erfpctlve prior to the 
reorder l,ng of the sequence. 

> Panos (1972) drv loped a hlejrarchv for a "M.iri i.in I .inr.o t)'.*'" Mu- t.isU 

.malvsis recommended Dy Oagne (1962). Panos uso.l an *Mnplr-I.Ml pr*voihuo 
also recommended by 'lagne (1967) to validate the intordepcndonov ol iho 
tasks in the hierarchy. The instructional materials developed by the ro- 

. searcher were shown to He ^effective in a pilot study where \00% of the students 
mastered all of the tasks in the hierarchy. The empirical sequence was then 
compared •to'''"two degrees of reordered, sequences of learning sets. The hypo- 

" thesis was that as the empirical sequence is reordered the total learning time 
Increases. A trend just short/of the .05 significance level resulted. 
The lack of sigHif icance' was attributed to two factors. The analysis of 
Variance used in the study required an equal number of cases in each cell. 

- Because of a low number in one of the cells the total sample was greatly 
reduced from 66 to 45. Wering sample size increase the chance of rejecting 
a true hypothesis (type I error). The second factor affecting the results 
was that the maximvan time" limit used for the experiment did not allow the 
slowest students to achieve mastery. If there is an interaction effect 
between learning rate and sequence, the elimination of these sttidents my 
have biased the data. 



Spencer (1971) developed a hierarcliy and instruction for an algebraic 
task. The experiment. compared the effect of hierarchical, reversal 
and random sequences on a number of criterion variables. The variables 
include^l: time to 'complete the program; number of errors- on' program 
frames mastery of subordinate competencies;" 'attitude toward the program;^ 
mastery of the task; and retention of the task. The results of an 
analysis of variance indiH:ated difference on only one variable. Those ^ 
students following a forward sequence made fewer frame errors. No other 
main effects or interact ions. with ability were significant. Doubt is 
cast on the interpretation of the above results by the fact thar 
validation of the instructional materials resulted In only a 67/49 ^ 
(67% of the learners scored 49% or better) criterirti» for the terminal 
task. With such a low level of effectiveness it is aoubtTul that any 
statement can be made regardinft the relative effiTi of ordered and re- 
ordered sequence on learning. * 

Wodtke, Brown, Sands, & Fredricks , (1968) conducted two experiments ' 
involving computer adirlinistered programs. One program, concerning number 
bases, was , hypo thesizied to be hierarchical; while th^ second program, 
teaching the anatomy /'of the ear, was described as non-hierarchical. 
ComMrison of ' wi thin-program performance measures for each program. - 
confirmed the hypothesized structures.. Whereas -'a reordering of the number 
bases program af fejc'ted the error rate, the reordering of the *ar anatomy 
program did not. /The experimenters took this differential effect on 
error rate to ^' . .support their contention that the ordered version of 
"the modern mathematics program... did co.ntain an ordered conceptual 
sequence '(p. 64)." However the hv^otheses that (a) -scramoling the 
sequence of instruction lias a detrimental effect on learning a subject 
matter containing a conceptual hierarchy as opposed to a program con- . ^ 
taining a relatively discrete set of facts; and (b) that the scrambled 
sequence is more detrimental to the learning of low aptitude students 
than high aptitude students, were not supported. There were no achlovi.- 
ment differences or Aptitude^.X Sequence, interaction with respect to.po.sL- 
test performance. 

A simple box score of the results of the studies reviewed, showing. 5 
for and 6 against, does not provide emphatic support for the position 
taken by Gagne. The conflicting" results, however, indicate that metho- 
dological errors rather thap treatment effects may have played a signifi- 
cant role in the research. 

Methodological considerations . A number of methodologicar considera- 
tions are relevant to this Trea of research. One such concern was the 
topic of a study by Tobias (1972). He contended that lack of support 
for the. positive effects of proper sequencing could be explained by 
the fact that many of the studies used instructional content with which 
the learners had prior knowledge, and that the experiments did not tak<- 
into account this source of variance. Tobias hypothesized that the rfiori 
of sequence is modified by subjects' prior familiarity with thf: trontcnt. 
» It was assumed that on material with which sub jeers had extensive pr-vious 
experience even a scrambled sequence could facilitate achievement. On 
unfamiliar content, however, it was assumed that subjects would learn 



lc«s*fn)m a scrambled sequence than from a 'VeRulai' scquem-.i*. Iwo 
programs were developed by Tobias. The familiar content concerned the 
definition, prevalence, and. factors affepCing heart disease. The . ^ 
»unfdrailiar m^erial dealt witj» the diagnosis of*' myocardial infarction 
from the f miv'precodial 'lead of. the electrocardiogram. Logical and ^ 
scrambled versions" of both. programs were given to 117 educational psychp- ^ 
logy students.- The results indicated that scrambling had a strong eff.ect 
on Achievement for the <m familiar content but no. difference for the , . ^ 
familiar material. . • * * 

The Tobias studv indicates th« need for any research on sequence v 

to avoid content . which is fapUiar to the students involved in the 

experiment. Caruso' and Resnick (1971)". Oliver (1971),. Resaick, Siegel < 
^nd Kresh (1970). and Panes (1972) used content whidb was -invented / 

thereby eliminating prior knowledge on -the part, of *the learners Kane. 

(1971) and Phillips* and Kane' (1972) , and Wodtke et_al. (196HPused . 
' school subiect matter but made sure that there was |«ri or - learn inr 

of the material. The other studle-s reviewed (RoHion, 1970v Urown,. 1)70; 

Eustace, 1969; Niedcrmeyer. ot al .. 1969; and S,M'n.-..r, l'>71) used srhool. 

sub.iect matter without providing the assurance that there was»no prior- 

learning. . ' 

•• ' ' . K ^ ' 

5 A second methodological. cohsl<leration is one of the empirical 
validation of the proposed hierarchy. Once a hierarchy is constructed 
'using task analysis (G^gne, 1962) or some other approach, there remains 
a need tO" validate the structure empirically. Without making this 
provision the researcher could' not Be confident that the structure of 
the learning sets was Indeed a hierarchy. A study which does not use . 
an em|-mcally validated hierarchy compares, in effect the "researcher's 
hierarchy" with a scrambled version of the "researcher s hierarchy. 

• Boston (1970). Brown (1970) . ' and pknos (1972) ^^^^^^^^^^^Jte^T^^^^ 
by Gagne (1967J -Xo validate ^heir hierarchies. Kane (19.71 and Phillips 
^ and Kane (1972) Wd a method described by Walbess.r (196B) and Eiscnberg 
and Walbesser (1971). Eustace (196P). Niederm..yur . vt_aU .(1969). 
Oliver (1971). Spencer (1971). and Tobias (1972) MM not report an : 
empirical validation of their hleran-hlos. Ccras.. and Ke.snl.l^ U*/ ). 
and Resnick. Sl^el and Kresh (1970) did not validate their hierarchy 
other than by the experiment itself. 

A third methodological concern is one of empirically validating 
the instruction used In the experiment.' The need for ef fective^instruc- 
tion in a study which examines the^ effect of sequence is obvious. 
Without effective instruction there is no "effect" to examine other than 
the relative lack of achievement. 

, bespite the importance of effective instruction f^"^ ^'^r^^!"-"' 
(Brown. 1970; Caruso and Resnick. 1971; Eustace. 1969 Oliver-. i971. 
Resn^k. Sle^el and Kresh, 1970; and Tobias. 1972) failed to report , 
theval dation of their lAstruction. Spencer (1971) achieved only 



rt 67/A9 criterion for the termliinl tnsk in ht*r v.»I hial Ion artiMi»pt. 
Boston (1970), Kane (l97l) nml I'hUltprt and Kan»' (l«>/:'). I'aiu.g^t l'5/:M 
nnd Wodtke at a1 . (I9'>a) ro|>orti'<l lUv valltiatUm .»l rllvi l Ivr - 

tionAl materials.. * - . 

. s 

A fourth methOiloloKlcal conslMoration Is whotluT the s<'(nu'n» i' .was 
reerdered by leernlnp sets or by Instructional frames. The theory of 
Hagne discussed previously contends thaft it is the mastery of a sub- 
ordinate learning set which facilitates the learninR of a superordinate 
learninf? set. No contention is made regarding the relation between 
instructional frames and leaminp. sets. The reorder>ingN of frames has 
an uricertain effect on the structure of the hierarchy; it also has an 
uncertain effect on the results obtained. A numbef of researchers 
whose work was reviewed (Brown, 1970; Niedermeyet, et al ., 1969; Tobias, 
1972; and Wodtke et. al ., 1968) reordered their sequences by program 
frame rather than by learning sets. ' * 

A final consideration is whether masteify of a skill was used as 
the criterion rather than an achievement test score, 6r merely time on 
task. The writings of Bloom (1968) and Carroll (1970) emphasize the 
need for the use of a mastery criterion. Mastery in defined as the 
display of a predetermined level of competency of a Hpifclflc skill* on t iio p 
of the learner. The use of mastery .is a criterion prvivIdcM n mor«- vall.l 
'rtea.sure-^f the intended outcome (»f tiu* Instnu l Ion: ahlllLy lo p<'rUinii^ 
the a^cquired skill. Whereas mastery Indicates a dlllercQn- belwecn^^:; 
knowing (to the degree desired by the instructor) and not knowing, 
achievement scores create dubious differences between a score .of 55 
and a score of 60 (for example). Although a mean score of 55 (out of 
l"00y and a mean score of 60 could be statistically significant, it is 
of doubtful meaning in practical terms. A statistical difference in the 
number of skills mastered has much practical signif icanpe. 

Treatment effects on mastery can be measured as the number of 
learners mastering a particular ski.ll, the number of skills mastered, 
or the amount of time or number of trials needed by each learner to 
mafeter a skill. Boston (1970), Caruso and Resnick (1970), Panos (1972), 
Resnick, Slegel and Kresh (1970) and Spencer (1971) examined the effects 
of sequence on the mastery of the subject content. 

A list of the studies reviewed in this section is shown in Table 1. 
An "X" indicates that one of the methodological considerations discussed 
above wa.s taken into account by the aathftr. A quei Ulon mark ImllcaK-s 
that the* author did not report on that aspect of the methftdology. A.s 
can be seen, the only study which accounted for all the >lstcd conr.fru.s 
is Panos (1972). Although the results of his sttidy were not slgnificanL, 
promising trends exhort further study of the topic. ^ ) 

• .' ' ■' 

One further methodologicat consideration . Confusion exists as to the 
exact effect -sequencing has on learning. In one work Gagne (1970a) 
describes the relationship between superordinate and subordinate skills 
as this: 
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Table 1 

Methodological Considerations In Rovlewed # 
■Research on Hierarchical Sequencing 



Study 



Avoid Prior Validate Validate Reorder Uy 
Knowledge Hierarchy 'ins true- l.onrning 

tion Sets 



\ 

Mastory ^ 
Crltiirion Uesult: 



Boston (1970) 

Br6wn (1970) 

Caruso & Resnick X 
(1971) 

Eustace (1969) 

Kane (1971) and 
Phillips and Kane X 
(1972) 

Niedenneyer et al , 
(1969 )■' 

Oliver (1971) X 

Panos (1972) X. 

Resnick, et al . X 
(1970) 

Spencer (1971) 

Tobias (1^72) " X 

•;odtke, et al . X 
(1968) 



X 
X 



X 

7 



X 
9 



X 



X 



X 



X 



X = Methodological considerations accounted for 
? = Methodological considerations not reported on 



X 



Support 
Support 
X Support 

Support 

No Support 
No Support 

No Sui)p(iri 
Trend 
Support 

No Support 
Support 
No Support 



X 
X 



the superordinate capability will be more readily learned (on the 
average, throughout a Rroup of studi-xts) if |he subordinate capa- 
bilities have been previously acquired and are readily available 
for recall (p. 239). 

In a second statement it is .described like this: 

An individual will not be able to learn a particular topic if he 
has failed to achieve any of the subordinate topics that support 
it (Gagne, 1963. p. 624).' 

The question arises: Are subordinate skills facilitators or necessities? 

It is the position of the researcher that such a discrepancy is of 
methodological rather than a theoretical nature. The degree to which 
mtersequencing affects learninp depends in part on the degree to whi.-.> 
the learner has control of the processing of the instructional materials. 
Whereas the learner who can control instructional materials can manip- 
ulate them in such a way as to compensate for a reordered sequence 
(although at a cost in time), a learner who does not have contro^l of 

-the materials will not be able to learn if the materials are out of order. 

-In the first -case the subordinate skills are facilitators, in the second 
case they are necessities. 

This position requires that a study of the effects of sequencing be 
divided into two experiments. In one experiment learners are assigned 
to either an empirically validated or a reordered sequence. Learners 
in this experiment do not have control over the sequence. Each learner 
is allowed as much time as needed to complete instructions for each 
level of the hierarchy but in a predetermined sequence. The variable 
examined for this experiment would be the number of learners who mastered 
skills, and how many they mastered. 

In the second experiment the learners are Initially given cither 
empirically validated or reordered Ipter and intra-sequences. The 
students are required to continue working on the nnterlals until they 
mastered the terminal task. Therefore they are allowed to re'sequence 
the materials if they find it necessary. The effect of sequencing on 
time to mastery would be observed, thus examining the facilitative func- 
tion of proper sequencing. 

In tra-sequencing . The second type of condition that Gagne discusses is- that 
external to the l earner. These conditions are stimulus situations surrounding 
him at the time learning occurs (Gagne, 1970a, p. 302). Most commonly 
these are the verijal communications that are made to the learner , me so 
communications, or instructional events, function-to facilitate learnmj^ 
by "informing him of what he is going to achieve, reminding him of j/hat 
he already knows, directing his attention and actions, and guiding his 
thinking along certain lines (1970a, p. 29)." These events correspond 
to the way the learner internally processes information for learning. 
This process is described by Gagne (1970a, p. 71) as having four 
phases: apprehending, acquisition, storage, and retrieval. 
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External conditions should be arranged in the Instructional materials 
so as to assist the learner in his • information processing. Cagne (1970a) 
lists the events of instruction and their order: 

1. Gaining and controlling attention. • . 

2. Informing the learner of expected outcomes. 

3. Stimulating recall of relevant prerequisite capabilities. 

4. Presenting the stimuli inherent to the. learning task. 

5. Offering guidance for learning. 

6. Providing feedback. 

7. Appraising performance. 

a. Makirtg provisions for transferability. 
9. Insuring retention. • 

The Importance of the ordor ul Llic IuhI rue l I on.i I .vcnl.'; ii<.i.<t l>y 
fiagne : 

Typically, they occur in approximately the order listed, 
although there is no absolute requirement about this order. 
As Is implied, however, the critical learning occurrence 
transpires between events 5 and 6 in this list. One could 
hardly expect, therefore, that events transpiring prior to 
5 could be temporally switched with those occurring- after 
* (ibid., p. 305). 

Related research . If the hypothesis regarding the sequencing of , 
learning sets seemed to hold conflicting support from the research, 
the above statement;3would hold almost no support. The large. majority of 
research done during the past decade on logical versus random sequencing 
of instructional items could be interpreted as addressing itself to 
the hypothesis that the order of Instructional rommun lent Ion makes a 
difference in learning. Of the notable studios examining tho t-M (mlm 
of the sequence of instructional fram«'s (liaison, l'>7l; liucklan.l, I9f>«; 
Cartwrlght, 1971; Conley, 1968; Hamilton, 196A; Harrington, 1966; 
Hegedus, 1971; Levin & Baker, 1963; Maier & Jacobs, 1966; Payne, Krath- 
whol, & Cordon, 1967; Roe, 1962; Rose, Case, & Roe, 1962; Reichert, 
197i; and Stolurow, 1964) only three (Conley, 1968; Hegedus, 1971, and • 
Roe, 1962) showed significant differences in performance that favored 
the logical sequence. ^ . 

Methodological considerations . , Two characteristics are shared by 
all of the studies cited above. 

1. The original intra-sequence (prior to reordering) was 
"Logically" ordered. 

2. , A criterion other than mastery was used. 

The methodological concerns involved in point 2 were discussed 
earlier in this paper. Point 1 raises a concern unique to this set 
of studies. in all of the studies the proper sequence was logically 
arranged, yet none of the studies provided an elaboration of the crit.-riou 
used to determine the "logical' order". There was no statement similar 
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to the list of eventa ol" IhHtrui i Ion provliloil hv Thei 
process described to determine the "loRicalness" o\ iho fni rn-siMnuMu c 
analogous to Gagne's proems of task analysis used to determine the 
dependency of learning tasks. 

» 

The doubt that such objective criteria exist is fostered by the ^ 
statements of proponents of prograued instruction. Skinner (1968) in 
describing the requirements of a teaching machine states: 

A second requirement of a minimal teaching machine also 
distinguishes it from earlier versions. In acquiring complex 
behavior the student must pass through a carefully designed 
• " sequence of, steps, often of considerable length. Each step 
must b^ so small that It can always be taken, yet in taking it 
the student moves somewhat closer to fully competent behavior. 
The machine must make sure that these steps are taken in a 
carefully prescribed order (pp. 34-35). 

Yet the "carefully designed sequence" and the "cnrnlully prcHoribotI 
order" are not defined. Tn Lysaught's (1963) text on proHramniiMl 
learning he states^ as one of the characteristics of a successlul 
program: * 

Logical sequence of small steps . Subject matter, broken 
dovTH into fragments of information, is arranged in an 
orderly sequence of growing difficulty so that the student 
may progress from one point in the program to the next (p. 17). 

Again, there lacks an objective description of what constitutes a logical 
sequence. . ^ 

' The statements cited above are sufficiently vague that a programmer's 
interpretation would represent a large subjective factor in the program 
design, Subiective factors minimize the generalizability (and inter- 
pretability) of the effects of such programs. 

A methodological consideration that this grotip of studios shares 
with the group of studies reviewed on sequencing ol learning acts Is 
that of program effectiveness. .Some of the studies examining the; 
sequencing of communications, notably Payne, et al . (1967), and Levin 
and Baker (1963), used instructional programs of dubious effectiveness 
even in the logical form. Payne, et al . showed only a mean score of 
37.5 out of a 56 item criterion test for the logical group. In the 
discussion of their results Levin and Baker conclude: 

Probably the most important limitation of the present 
study was the failure of the program to teach the material 
presented thoroughly to most of the subjects, as indicated 
in post-test performance (p. 143). 
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The lack of difference between logical and scrambled frame instruc- 
tion can be explained, in general, by two factors: A lack of empirical 
validation for the sequence termed "logical"; and the lack of effective- 
ness in the instruction used. % 

Inter X Intra-sequence interaction . The theory of Gagne reviewed 
previouslv indicated that both inter and intra-sequencing play crucial 
roles in iearning. If either the inter or intra-sequencing of instruction 
are drastically altered, learning would occur only with great difficulty, 
if at all. However Gagne does not take a position on the relative 
importance x)f inter or intra-sequencing for the learning of intellectual 
skills. • • 

A study of Miller (1969. 1967) showed the poBKlhlo inter-relatioushlp 
between the inter and intra-sequencing of instVurt i on. In his study 
Miller divided an instructional program into what In- termed macro (Lopics) 
and mid ro (frames) order. The resjults indicated that students using 
the program vfliere micro order was random but macro order was preserved 
performed better on criterion measures th.^n those students using a 
program where the micro order was preserved and the macro order wa'. 
random. Furthermore, the random micro ordered program took longer'than 
the program which preserved the micro order even though there was no 
difference between the groups on post-tests. 

Conley (1968) reported results for a unit in Nursin'g which was 
arranged into four sequences: i.e. logical block-logical item, logical 
block-random item, random block-logical item, and random block-random 
item. The students following the logical block-logical item sequence 
performed reliably" better on both achievement and retention tests 
than learnerqi f rom other groups. However, ^ relative effect between 
logical block-random item and random block-logical item was not indicated 
as it was in the Miller study. 

. Neither the Theory or research on sequencing provide a clear 
•indication of the expected direction of any interaction between later 
and intra-sequence. ,Tlie fact that the same pattern 'did not- recur in 
the Conley and Miller studies does not provide a foundation for a 
hypothesized interaction. Therefore, the investigation of the interaction 
between inter and intra-sequence is phrased in question form. 

The literature reviewed suggests the following questions: 

Does the order of the -inter-sequence have more of an effect on time 
spent to master skills^ than the order of the intra-sequence? 

Is there an interaction between inter and intra-sequence? 



Learner var iables . 

- ■ , , p 1 - — — " 

., t 

Although the cumulative learning theory is verv 'emphatic about the 
desirability (if not necessity) of learning subordinate learning sets 
prior to learning of supprordinate skills, Gagne (1970a) concedes that 
there are learners who cafi'"skip over" skills. He doeg*.not say that 
these learners do not acquire the subordinate skill (this would contra-- 
diet the theory), what he does say is that they "acquire both the 
subordinate and superordinate skill in one intellectual jump (p. 241). 
Gagne refers to the students who caji do this as "bright" students. 

♦ ' • ■ 

A number of studies examining hierarchies and sequence have 
encountered interaction between sequence and some measure of intelligence 
or a|>ility. Buckland (1968); Levin & Baker (1963); and Stolurow (1964) 
.showed tKat whereas bright (high TQ) learners did Wull 1p*^lthor Lhf 
logtrally or flcramblod sequence, tlu' low HUHlmls did ^mly «»«» 

tht' logically sequenced pro^,ram. ()Hvt?r (l'»7l) Khnwv^-tr ^slnrl t^.n 
interaction between treatment groups and the factored ability 
of induction. , 

Studies by Brown (1970) and Niedermeyer, Brown, and Sulzan (1969) 
showed no such interaction. The fact that both of these studies, used 
populations with above average mean IQ's (Bro«m: mean IQ 120; Niedermeyer 
et al . , mean IQ lil) on the same program ( Number Series) may partially 
explain the conflict between their results and those of other studies. 

A learner variable termed "learning rate" was used to examine 
Treatment X Aptitude interactions in the present study. Carroll 
(1970) defines learning rate as "... amount of skill learned or knowl- 
edge gained per unit time (p. 38)." The learning rate task used in 
this study, topographically similar to the experimental task, -was 
the amount of time used to master a reading comprehension task. The 
researcher felt tlfet because the learning rate task- required the sam^ 
type of behaviors (I.e. decoding, comprehension, etc.) and was measured 
-in the samfe units of measure (time in minutes) as the experimental 
task it would extract more variance than an IQ measure. 

Although a learner variable was used in this study primarily to 
extract error variance, interactions among learning rate and inter 
and intra-sequence were examined. An answer to the following question 
fs posed: Is there an interaction between either inter or intra- 
sequence and learning rate? r-.' 

Hypotheses and questions . The following hypotheses and questions 
were examined in this study. 

With regard to determining the effects of inter-sequencing on learn- 
ing it was hypothesized that: 
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In .a situation, of learner'^opt Ion to roorUor ilu- Int fi -hu.iu.m.uht 

* < ■' ». 

t 

. II 1 tearners prcHcntofI wlili .in i*mplrlr.illy v.H hl.ii .lni<«- 

aequencc take Icsk tlniv oii. csirh levol ol ( .Nks lo .i.-Miihi- ilio 
terminal skill than those learners pr.Heni.d wIlli a r ..."ir.lor.-J 
inter-sequence. 

In a situation of no learner option to reorder the inter-sequence; 

H 2 Learners following an empirically validated inter-sequence 
master more skills than those learners following a reordered 
inter-sequence, 

H 3 Of those learners mastering a superordinate skill, more 
learners also master all relevant subordinate skills than 
will have not mastered lower skills. 

With regard to determining the effect of intra-sequencing on 
learning, it is hypothesized that: 

In a situation, of learner control of the Intra-sequence: 

H A Learners presented with an empirically val I<laled inlr.i- 
sequence take less time on each level of tasks Lo .icqnirc 
the terminal skill than those learners presented with an 
inverted in-tra-sequence. 



With regard to both -inter and intra-sequencing, ans\^rs to the 
following questions were sought: 

Q 1 Does the order of the inter-sequence have more of an effect 
on time spent on each level of learning sets to master the 
terminal skill than the order of the intra-sequence? 

Q 2 Is there an interaction between inl^er and intra-sequence? 

With regard to the relationship between individual differences and 
sequencing, answers to the following questions were sought: 

Q 3 Is there an interaction between either inter or intra-sequenc- 
ing and learning rate? 

Procedures 

De veloping the learning hierarchy . As was discussed previous'ly 
Tobias (1972) noted that whereas the learning of subject content that 
was familiar to learners was not affectet by reordering, the learning 
of unfamiliar subject content was susceptible to a Reordered sequence. 
To avoid confounding the effects of prior learning and sequencing, a 
contrived terminal rule-using task was created. Figure 2 is an exam- 
ple of this task in which the learner must pick the best poison to 
use on the group of germs. 




Stop 

Underline the best poison 

Figure Example of item from test of mastery af the 
terminal ^^Ul.of selecting the best poison for a given 
group of germs. Learners must know which poison will 
kill all the deadly germs and the fewest helpful germs. 
At least four correct responses to five items were re- 
quired for mastery. 



in order to solve th4 terminal task it is necessary Tor the studc^nt 
learn to use the rule: The best poison Is the on. thai kills a the d.aa- 
ly Kerms'and the fewest helpful P,i.rms. In ordor lo us. « 
Is theorl7.ed that' the- learner must also have learn..! Q n.nulu.. o, p. 
r^qulfllte skills. 

A hierarchy of skills suhordlnaLo to the Lormloal i.ask was .U-rlvod . 
by a process of task analysis described by napne (W(,2). The analysis 
was begun by asking what would «n individual have to know how to do 
m order to achieve successful performance of this, class of task, 
assuming he were given only, instructions? By examining the terminal 
task it was determined that it wa» necessary for the learner to know: ^ 
what a deadly germ is. what a helpful germ is. which germs End ^ills. 
and which germs Stop kills. These concepts compose the second ^evel ot 
the learning hierarchy. A third level of skills requiring the discrim- 
ination of L conceptual attributes of "tap", "blik" and- "dod" completed- 
the hierarchy. 

The hierarchy shown in Figure ,3 does not include such concepts as: 
aerm kill helpful', deadly, fewest, all. and poison, which were also 
derived as* subordinite skiUs by task analysis. It. was the -assumption of 
the researcher that these skii;Ls were universally held by the learners 
used in the study (8-12 graders). 

Pilot "-^^'^ ^ T - vnitdatine the inter-seguence . Walbesser (1968) Elsenbcrjj 
Ind SalbLL (19/a) has developed a prc ! cedure for validating the proposed 
interdeoendencies of the skills in a learning hierarchy. The procedure 
b^ginf brteaching the skills in the hierarchy, to a number of learners then 
testing them on tiheir mastery of each skill. . This data is used in com- 
puting' a "consistency ratio". The consistency ratio provides a numerical 
^i e?ion for testing the dependency among learning set^. ^^L^^'^he ' 
ratio tests the assumption which the ^constructed hierarchy makes The 
assumption is that "if aft^r instruction the student has acquired the 
: teriiinal behavior of the hypothesis, then he should also have acquired . 
.all subordinate behaviors (Eisenber and Walbesser. 1971. p. 

The consistency ratio is the number of learner.s who mastered both 
the superordinate skill and all relevant subordinate skills (e^P"f 
as the ordered pair:'l.;). divided by the number plus the number of stu- 
- dents who mastered the sb^erordinate skill without f^^"^";^ all the 
subordinate skills (expressed as the ordered pair: l'^). The result 
is the percentage of those Learners who-ma*te^' superordinate skills 
who also mastered all relevant subordinate skills. The consistency 
ratio formula is written as: ^ » 

f (1.1) + f (1,0) ' ; . 

' Ratios computed for each superordinate skill and its relevant 
subordinate skills indicate the degree to which the assumption stated 
above is valid. The "relevance" of a subordinate .skill i« Jj^^^^^^^ 
the lines connecting one skill co another in the diagram of a hierarchy, 
so thaf the ^elevan? subordinate skxlls to Skill I f ^^^^.^^^^^^ "^f ^" 
this study (see Figure 3) are Skills T.A. IIB. llC. and IID; the skill 
subordinate to skll IIA is Skill IHA. and so on. - . 
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However, the consistency ratio would be of little practical value if 
all of the students in the sample tested mastered all of the skills, both 
superordinate and subordinate. Although the ratio would be 1.00 
(maximum value) for all learning sets, the ratio would become more an 
indication of the effectiveness of the instruction than a test of the de- ^ 
pendency of the skills. A researcher Interested in va4^idating a hierarchy 
is interfested in knowing that if a subordinate skill is n©t mastered, no 
adjacent subordinate skill will be mastered** For this reason the 
researcher is as interested in, non-mastery as in mastery during the hier- . 
archy validation phase. In order to obtain a distribution of nonmastery 
among the learners the instruction must be less than thoroughly effective. 

The students in Pilot Study 1 were given instruction for all of the 
learning sets In the hierarchy. However, in order to r.«t less than lOOZ 
effectiveness, the instruction was presented verbally and In a U-hh ' 
thorough manner than in the written material used during ilie scu-cmil 
Pilot Study and the experimentation. 

Pilot Studies I and II were conducted with 28 available junior high ' 
school students (grades 7-9) from the Wayne-West land summer school . ^ 
program. Fourteen of the students were assigned to Pilot I, ana four- 
teen 5rejre assigned to Pilot Study II. . , ^ 

The students In Pilot Study I were presented with the Instruction. 
After the lecture the learners were'glven a test identical to that which 
was used in the experiment (see Appendix A). The test consisted of five 
item's for each learning set. The tests were corrected and scored on a mas- 
tery basis using an 80% criterion (A out of 5) for each learning set. The 
resulting distribution of mastered skills Is shown in Table 2. The 1 s Indi 
■'cate mastery while the 0»s show that mastery was not achieved. Consistency 
ratios of 1.00, IIA; .93, IIB; .92, IID; and 1.00 for task I were obtained. 
This indicates. that the hypothesized hierarchy was interdependent in the 
way expected. 

Only one case (student my out of fourteen wn« inconsistent with 
the supposed Interdependency. In only three Instances out of a total of 
seventy adjacent subordlnate-superordlnate pairs (or A%) was there 
mastery of a superordinate skill without mastery of the relevant sub- 
ordinate skill. ,rhi's percentage Is close co the 3% recorded by Gagne 
& Paradise (196i) in their study of hierarchical learning. 

The hierarchy displayed In Figure 3 was accepted as empirically 
validated. The sequence of learning sets based on this hierarchy was 
termed the empirically validated Inter-sequence. The order of pre- 
sentation of the Instructional lessons for the empirically validated In- 
ter-sequence Is: IIIA, IIIB, IIIC, IIA, IIB, IIC,' IID, and Lesson I Is 
the Instruction for the terminal task. 

Designing the Instructional materials . An instructional lesson was de- 
"slgned by the researcher for each learning set In the hierarchy. The 
instruction was based on the nine events described by Gagne (1970a) Gagne 
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Results of rMlot Study I: Sbowlcff 
Pass -Fall Pattern on Kach I^carnlyg 
Set Ift the Hierarchy 



Student # 


^ Learning 
' IIIA IIIB IIIC 

• 


Sets 
IIA 


IIB lie 


IID 


I 




1 


1 1 1 


1 


1 1 


1 


* 




2 • 


1 1 A 




1 X 


1 


1 




• 3 


1 .1 1 


1 


1 1 


1 . 


1 




4 


111 


i' 


1 1 


1. 


1 




5 


1 1 1 , 




1 1 


1 


1 


<• 


6 


1 1 1 


\ 


1 1 


1 ■ 


0 




7 


11 1 


1 


1 ' 1 


1 


0 




8 


1 1 1 


1: 


11 


1 


0 




9 


1 1 1 


1 


1 J 




0 


/ 


10 


1 1 1 • 








0 




11 














0 0 0 








0* 




12 


111 






0 


0 


/ 


13 


111 




1 0 


0 


0 




14 


11 1 




1 0 


0 


0 
















f 



ConFlstance Ratios 

IIA IIB lie IID 
UOO .93 .92 .92 



(1.1) 



(1,1) + (1.) 



I 

1.00 



i - mastered 
0 « not maatcred 



* contrary to expected pattern 



and Rohwer (1969 ).s RevievinR thoy are: 

■ \, Gaining and controlling attention.^ 

2. Informing the learner of expected outcbtnes. . ^ 

3. Stimulating recall of relevant prerequisite capabilities. 

4. Presenting the .stimuli inherent to tl>e learning task. 

5. Offering guidance for learning. 

6. Providing feedback. 

• * 7. Appraising performance. ' 

8.. Making provisions for transferability* 
9., Insuring retention. 

The instruction was In the- form of a small frame, overtly "^^^^^^ 
p. muUiple choice responding., linear program, ^^^^^"^^^f ^ ^^.^rn^ecf 
lesson presented a picture of a germ or a group of Bf "^f J^^^ 
the clnas of stimuli for the task of the particular lesson, and directed 
t^e learner's attention to the portion of the example whiol, wan re ev.^n. 
to the concept or rule hcln, taught. Kvunt 2 wan a Htntoft^ent ol llu- W-.^ 
havtoral ohiectlve For the lesson. . , 

Because some students in the experiment ^"'^ 
tion in a reordered inter-sequence it was a fear "-^/^f ^^Jer " 

exnllcit review of prerequisite skills would serve to correct the order 
^v'ie^chirg'm^^^^ in other words a -^^^ ^^^the^ea^lnef who 

Instruction for .Taslv HA would serve to teach Skill lA ^^^^^^^^^^^J^^^^ 
^oroivlntt IIA first in a reordered inter-sequence. - Such an occurrence 

. ::tir .f:^'tJ"p"pose »£ th. experiment «>««ff ' "^J^f J,";;^^: g„ 
rplpvant nrexeauisite capabilities (Event 3) was not included In the aesxgn 
of the lessors for the superordinate skills. However, subtle cues were 
empJoyed to "oS recall of the skill if it had been learned from a previous 
lesson. 

Event 4 was accomplished by presenting an example of items similar 
to those that would be encountered in the test. Neither response or 
Tee back wafrequired for this frame. For Event 5 the attr bute con- 
nnnt or rule was stated, accompanied by an example of its use. A single 
tes Uem i?th LedbLk* functioned as Evenf6. followed by a series o 
Uems similar to those on the test, and appropriate feedback (hvent 7). 
iransferabUlty was provided for (Event 8) by indicating how the newly 
learned skill would be used in the following lessons. 

Spaced practice was used to insure retention in Event 9. The spaced 
practice was emulative as the^ learner progressed through the lessons 
?or a particular level. Practice for previously learned skills was in- 
Muded onJy S Lssons for skills on the same level of the hierarchy and 
nit in Wessons for a superordinate level. Practice for subordinate skills 

not included in the'higher-order lessons in order to avoid teaching 
these skills to students who followed a reor4ered sequence. 

The resulting instruction was printed and cut into 8 1/2" x 2 1/2" 
' strips, ^he pages of the instructional lessons for each learning set 
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,«rc stapled into three booklet-, one for each l.v.-l. Hook 1 la.Uul- 

formula is • , . ' • 

f (1.1) 

f (1,1) + f cu,i; • 

This tests the degree of effectiveness of the lesson for" those studentr; 
" who have the prerequisite skills. 

ft 

The completeness ratio Is the number of'stu.U-ntK «l,o nu.»tered both _ 
subordinate and superordi^te skill (1.1) <ilvI<1o.l by that n«be 
■plus those *omas?ered neither the superordln.nte m.r .uhordlnat. ,.UU,> 
(0,0). The formula is: - ^ 

' f tl.l) 



f (1,1) + f (0,0) 



This ratio Riv€S an indication of the cumulation of non-learners at a . 
specific point ix. the hierarchy. The ran^e for bo^h ratio^ is 0.0 to 
l!o! a higher number indicating a higher 'degree of effectiveness. 

Fourteen iunior high students remaining from Pilot Study I J^^^^'^f 
the ins^ructio^r^terLl in^^the valid inter-sequence and ^ypo.f ^^^-^ 
StrWequence. Air students began with Book I at the same time. They 

t^'in^a^d lln'^hey^inl^oo^ ftl they took the test used in Pilot 
Study I and the experiments. 

The tests were scored as they were in Pilot Study 1- '^^^^ j^.-'^^^^^'^- 
tion of mastered skills is shown in Table 3. , Adequacy -ratios of .8&, 
IIa" ? Oo! IIB; .86, IIC; .71, HD; and .86 for task 1 were ob^ined. . , 
Th^ci;pUte'ne;s raiios w.re: 1.00, IIAr^OO. IIB;, ^^^^ 
TTO and 67 fof I. - Note also that there was bnly one instance. (*) 
iieJe a siplrordiilie skill ,wa^ mastered without mastering all -relevant 
subordinate skills. . ' . / 

V T^MiaMon The experimental population consisted of 99 senior high 

and statistical tests. . ' 
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Table 3 

Results of Pilot Study 11: Showing 
Pass-Fall Pattern on Each Learning Set in 
the Hierarchy and Effectiveness Analysis 





Learning 


Sets 








Student # IIIA 


IIIB IIIC 


IIA 


HB lie 


IID 


I 


1 1 


.1 1 


1 

» 






1 


2 1 


. 1 1 


1 


1 1 




1 


3 1 


1 1 


1 


1- 1 




1 


4 1. 


1 X 


.1 


1 1 




1 


5 1 


1^ 1 


1 






X. 


6 1 

t 


• 1 1 


1 






1 


7 1 

8 1 


1 1 
1 1 


1 
0 


1 1 


1 


1 


9 1 


1 .1 


X 




j[ 


0 


10 . 1 


1 1 


0 






0 


11 1 


1 1 


1 




0 


0 


12 1 


1 1 


1 


;>i 1 


0 


0 


13 1 


1 1 


1 


1 0 


0 


0 


14 1 


1 1 


1 


1 0 


d 


d 


Adequacy Ratios 






(Ul) 


o 






(1, l)+(0,.l) 







UA IIB ' lie . HD I 

.86 I.PO .88 .71 .88 

Completness Ratios 

IIA IIB ne IID I 

1.00 1.00 1.00 1.00 .67. 



* contrary to expected pattern 



(1.1) 



<lit)+(0, 0) 



1 = mastered 
0 = not mastered 



Experimental design . The design for Experiment A was a 2 X 2 X 2 complete 
factorial design. For the purpose of control and examination of inter- 
actions, learners in Experiment A were divided ifnto high and low learning 
rate Rroups based on a time-to-masteryi reading comprehension task. 
Learners were then randomly assigned to either emplrlral or reordered 
inter and intra-sequence groups, thus comprising thu matrix shown in 
Figure 4. . ' - 

^ The Instruction for the learning sets was rt'oidort'd l>y InnT- 
changing Book I (instruction for Level 11) with Book 11 ( Inst rui i Ion l*»r 
Level III). Those students who followed a reordered intcrsequence 
received the books in this order: II I III. Learners receiving 
this sequence would be in a position of having to learn a superordinate^ 
skill without 'first learning the skills subordinate to it (an accomplish- 
ment not likely to 'happen according to the theory) . The learners receiving 
the empirically validated sequence receive instruction for the subordinate 
skills followed by. instruction for the syperordinate skills (Book I, Book II, 
Book III). 

The events of .the lessons were reordered for intra-sequence by inverting 
the order of the frames or sets of frames which corresponded to Gagne*s 
events of instruction. The order of the events for those students who 
received the inverted intra-sequence was: 

98756^121 

The order wns^lnverted around. Events 5 and 6 a.s suj'j'.f.s n»<l by Ca^n^^ (I'i70a, 
p. 305).. Hypotheses 1 and 4, contended that learners lollowlnj* v-MIkt a- 
reordered inter or intra-sequence would require more time to achieve 
mastery of the terminal task than those students who follow an empirically 
validated sequence* ' ^ - - • 

Inter-sequence' only was manipulated in Experiment B. A modification 
of the post-test only control group design (Campbell & Stanley, 1963) was 
used for the second experiment. Two groups (empirically validated versus 
reordered inter-sequencing) were compared on post-tests at the end of each 
level of instruction. The pictorial representation of the design is 
this: 

R X^l Ol ^e2 O2 Je3 ^3 
R Xri Oi Xr2 O2 Xr3 O3 

Students werp randomly assigned (R) to each group. Instructional lessons . 
were received in either an empirically validated (Xe) hr reordered (Xr) 
'inter-sequence. ^Reordering for Experlm<$nt B was the same as for Experiment 
A. After each lesson the^-eaxner received a test (o); all tests were identical. 

' ' Testing Session . Ihe first session of the experiment was a two hour 
testl ig sessloji held on a' Tuesday morning in place of regularly scheduled 
classes. The te^litg- was done in each of four .classrooms. The researcher 
did not have the names of the students prior to the testing session, 
therefore random assignment to. the classrooms would have been difficult. 
Students were assigned to the classrooms by the class that they came 
from. Members of all treatment groups were in each of the classrooms. 
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In t r a^sequence 

Reordered 
Empirical 

Empirical 



Inter-sequence 



Re-ordered 



Figure 4 



Learning R;ite 
High Low 



1 

i 

! 




1 
1 

1 

i 

i 





Figure 4. 2X2X2 matrix of the design used in Experiment B, 
showing the factors. 
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Identical directions were given to the monitors ^nd identical directions 
were read to the students. . Proceaures were followed in all of the rooms 
that would minimize disruption and cheating during the session. 

During the testing session the learners reci-ive the Learning Uato-Test 
and a set of factored ahili'ties tests. The Learning Uate Test was used 
tc block Igarners for Experiment A. The ability tests of memory, per- 
ception, and induction were used for puposes not reported on in this 
paper. ^ , 

Experim ental session . The instructional materials we.re miministered 

twQ days after the testing session, again in place of regularly scheduled 

classes. Experiment A was held in four classrooms and Experiment. B was 
held in one other. ' 

In Experiment A monitors for each room were given the same directions. 
Identical directions were given to each class involved by means of du- 
plicated audio tape recordings. When Book I had been passed out the stu- 
dents were told to begin, and the time was recorded. Although different 
clocks wdre used in different rooms, one clock was consistently used in 
each. 

The students were self paced and as each student completed 3ook I the 
time was recorded on the cover sheet of his book, and he was given Test 
I. When Test I was completed, the time was recorded on Book II and in- 
■ struction began. Test li was taken upon the completion of Book II and 
Book III and Test III followed. The time was recorded each time a bnok was 
requested and returned. I . . 

At the time a student turned in.TesVUt thv items for the Lerminal 
task were checked and if mastery was not. scored (criterion of 80%) the 
student was allowed to rei/iew any or all books (one at a time) and re- 
take the test. If masterV was again not scored, the opportunity to ^ 
review the materials was repeated. This process was continued unCxl . 
mastery on the terminal task was scored. At no time were the students 
told by the monitors what , the correct responses were, or which of their 
responses were incorrect.' As the .student mastered the terminal task 
they were directed to return to their classrooms, so that correct re- 
sponses could not be passed to other students. 

The experiment ended when the last student mastered the terminal 
task. In no case was a student still working when the two hours that 
were allotted- lapsed. 

Experiment B began when the monitor played a tape to the students. 
^ The tape introduced the session to the learners and told them what they 
were to do. When the tape was finished. Book 1 was passed out and the 
students were told to begin. The students were self paced in both 
experiments, though none of the students used the two hours maximum which 
was allotted for the experiment. 
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As each of the students completed Book I ho turned it In and received 
Test 1. When that was completed he was given Book 11* When Book II was 
finished Test II was taken. Test II was followed by Book III, and that 
was in turn followed by Test III. As each student finished Test III he 
was allowed to return to his classroom. 

None of the students were allowed to look at any previously taken 
materials. None of the tests were checked during the experiment, and 
no feedback was Riven" to the students as to the correctness of their 
responses on the test. The experiment was terminated when the last stu- 
dent completed Test III. 

Kc'Stll t K 

" • * ^ t* 

■p 

Kxpcrlment A . fn Kxperlment A the e^rfortK ol Init-r and Inir.ij 

sequencinR were measured. The two Icarninp rate groups were each divided 
/ into four groups corresponding to the eight cells of the experimental de- 
sign. Of the 8A students who participated in the testing session, 67 
chose to participate in the instructional session. Of those, ten elected 
to drop out and return to their classrooms before they mastered the 
terminal task. In addition two more learners were dropped by the re- 
searcher, one because he did not receive one of his books, another because 
the final test was accepted as correct when it was not. A total of 55 
students were used In the analysis of the data for Experiment A. Attrition 
did not seem to'be random and may have biases the results. 

The dependent variables were the total time spent on the instruction 
for each level of learning sets to master the terminal task. The 
grand mean for the* time spent on instruction for Level III was 7.127 
minutes, and 16.64 minutes for Level 11, and 17.64 mi mites for Lovol 1. 
The grand means arid standard deviations are shown in T;ible K, as wt- II 
as the means and standard deviations for tlu> I nt iT-sciniencc, Im ra-snni.-nc*- 
and learning rate groups. The means and standard deviations for carh icll < 
the matrix Is displayed in Table 5. 

The learners in Experiment A were required to continue reviewing 
the instructional material until they mastered the terminal task. Each 
learner received the three books at least once, and after they followed 
their assigned sequences they were allowed t'o choose any of the books 
as often as tUey needed in ordei: to master the terminal skill. Although 
they took the same test for each attempt at mastery, no indication of which 
items were correct or incorrect was given to the learners. Table 6 
shows by' number the order, of books that each student took before mastering 
the terminal task. As can be seen the initial pattern for those 
students that received the empirically validated sequence is 1'2 3; 
while the initial pattern of those students who received a reordered 
• sequence is 2 1 3. The empirical sequence group looked at an average 
of 4.1 books (the initial three, and review of approximately ort*e of 
the three books); while 41.2% of the students in this group required 
no review (they mastered the terminal skill after tafting the initial 
three books only). Students following a reordered sequence required an 
average of 4.0 books, and 63.6% of them needed no n^vicw. 
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Table 

Mean Learning Time in Minutes for 
Each Factor on Instruction for 
Each Level of the Hierarchy 



Factor 



Level 
I II 



III 



Inter-sequ^ce 
Empirical 
Reor(^ed 



7.364. 16.45 18.70 
6.773 16.91 16.05 



Intra- sequence 
Empirical 
Inverted 



Learning Rate 
High 
Low 



Grand Means 



7.500 
6. 741 



17.57 
15.67 



17.57 
17.70 

•J 



6.640 14.64 14.92 
7.533 18,30 19.90 



7.127 16.64 17.64 
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- * Table 6 

t 

Experiment B 
Order and Number of Books Taken 



Student # 



Books 



Empirical Sequence 



1 


1 1 


, 2 


3 




2 


1 2 


3 


3 




3 


1 1 


2 


3 


3 


4 


1 2 


3 


3 


2 


5 


1 2 


3 






6 


1 2 


3 






7 ' 


1 2 


3 


3 




8 


1 2 


3 • 


1 


2 


* 

9 


1 2 


3 


2 


* 


10 


1 2 


3 






11 


1 2 


3 


2 




12 


1 2 


3 


_ 




13 


1 1 


2 


3 




14 


1 2 


3 






15 


1 2 


3 






16 


1 2 


3 


2 


3. 


17 


1 2 


3 


2 




18 


1 2 


3 


2 




19 


1 2 


3 


3 




20 


1 2 


3 






21 


1 2 


3 






22 


1 2 


3 


1 




23 


1 2 


3 


2 


1 


24 


1 2 


3 


2 


2 


25 


1 2 


3 






26 


1 2 


3 


3 


3 


27 


1 2 


3 






' 28 


1 2 


3 






29 


1 2 


3 


1 


3 


30 . 


1 2 


3 


3 




31 


1 2 


3 






32 


1 2 


3 






33 


1 2 


3 


3 





3 2 
1 



3 3 1 



3 2 2 



(continued) 
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Table 6 
(continued) 



Student # 



Books 



Reordered Sequence 



. 34 




2 1 


3 1 


35 




2 1 


3 1 


36 




2 1 


3 3 


37 




2 1 


3 


38 




2 1 


3 3 


39 




2 1 


3 


40 


• 


2 1 


3 3 


41 




2 1 


3 


42 




2 1 


3 


43 




2 1 


3 


44 




2 1 


3 2 


45 




2 1 


3 2 


46 ' 




2 1 


3 


47 




2 1 


3 


48 




2 1 


3 


49 




2 1 




50 




2 1 


3 1 


51 




2 1 


3 


52 




2 1 


3 


53 




2 1 


3 


54 




2 1 


3 


55 




2 1 


3 


Empirical Sequence 








Mean .Number of Books 


4. 1 




% 1 2 3 Only 


41/2 


Reordered Sequence 








Mean Number of Books 


4,0 




% 2 1 3 Only 


63.6 



3 3 12 3 



\1 2 2 



1 

1 3 



2 3 
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Experlment B . In Experiment B the students were given empirically 
validated' or reordered sequences according to the group to which they 
were randomly assigned. Out of a population of 15 who participated 
in the testing session, only 10 selected to participate in the second 
session. Of the ten students who were involved in both sessions, five 
received the empirically validated sequence and five received the re- 
ordered sequence. Each student was tested at the end of the instruction 
for each level of the hierarchy. The tests were scored for mastery 
of each task using a 80% criterion <A out of 5 items correct). The 
students were not allowed to review previously received booklets at 
any time. 

Each learner took Test' I after completing the first book he re- 
ceived. Therefore the students following the empirically validated 
sequence took the test after instruction for the skills in Level 
TTT (IIIA, TUB, and IIIC) of the hierarchy, while the students who 
followed the reordered sequence took Test I after receiving instruc- 
tions for the skills in Level II (IIA^ IIB, IIC, and IID) of the ' 
hierarchv. The pass-fail pattern for each learning, set for Test 1 is 
shown in' Table 7. All of the five students following the empirically 
validated sequence mastered the three skills taught in Book I. Addi- 
tional skills were mastered by several members of che group. The 
five students following the reordered sequence mastered all but four 
of the skills taught by the lessons they received. Only four subor- 
dinate skills were mastered by this group. 

Table 7 also indicates that four of the students appear to have 
mastered the terminal skill. It is dubious that this was so, at 
least for the three learners in the empirical group, because they 
did not repeat their mastery performance on Test II. Use of constructed 
responses rather than multiple choice would have virtually eliminated 
any- chance display of mastery such as this. 

The Book II received by students following an empirically validated 
inter-sequence consisted of instruction for Sets IIA. IIB, IIC, and 
IID The Book II received by students following a reordered inter- 
sequence covered Skill IIIA. IIIB. and IIIC. As each student finished 
Book II he took Test 2. The pass-fail pattern for the skills of the 
hierarchy for Test 2 are shown in Table 8. The five students following 
the empirical sequence mastered all but -one of the skills for which 
they had received instruction at this point. Of the five students 
receiving the reordered sequence, only two failed to learn all of the 
skills taught in the first two books. 

Students from both the empirical and reordered sequence groups 
received instruction for the terminal skill (Learning Set I) in Book 
III. After each student finished Book III he took Test III. At the 
time a student took Test III, he had received instruction for all sub- 
ordinate learning sets regardless of which group he was assigned to. 
The pass-fail pattern for the learning sets for Test IIT are shown in 
Table 9. All but six skills were mastered by the empirical sequence 
group. T^vo students for the empirical sequence group mastered all the 
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Tablc 7 



Results of Experiment A, Test 1» Showing 
Pass-Fatl Pattern on Each Learning Set 
In the Hierarchy After First Instructional Book 



Student # 



Learning Sets 
IIIA IIIB mC IIA IIB IXC IID 



Empirical 
Sequence 

1 

2 
3 
4 
5 

Reordered 
Sequence 

6 

7 

8 

9 

10 



1 
I 
1 
1 
1 



1 
0 
0 

1 

0 



1 
1 

1 
i 
1 



1 

0 
0 
"0 
0 



1 

0 
0 
0 
0 



0 
0 

0 

1 

0 



1 

0 

1 
1 
1 



0 
0 

1 

0 
0 



0 
0 
0 
0 
0 



0 
0 

1 

0 
0 



0 
0 



1 


1 


0 


1 


0 


0 


1 


1 


0* 


0 


1 


0* 


1 


0 


1* 



1 - mastered 
0 ' not mastered 



* Students who learned superordlnate skills without learning all 
relevant subordinate skills. 



/ 



Table 8 

Results of Expertment A, Test 2: Showing 
Pass-Fp.il Pattern on Each Learning Set 
In the Hierarchy After Second Instruction Book 



Student # 



Learning Sets 
IIIA IIIB IIIC IIA IIB lie IID 



s 



Empirical 
Sequence 

1 
2 
3 
4 
5 

Reordered 
Sequence 

6 

7 

, B 
9 

10 



1 
1 
1 
1 
1 



1 
1 
1 
1 
I 



1 
1 
1 
1 
1 



1 
0 
1 
1 
1 



1 
1 
1 
1 
1 



1 
1 
1 
1 
1 



1 
1 
1 
1 

0 



1 

6 
1 
1 
1 



1 


i 


* 

1 


p 


1 


1 


1 


0 


.1 


1 


1 


. 0 


1 


1 


1 


0 


1 " 


1 


1. 


0 


1 


1 


1 


0 


1 


0 


1 


/ 0 


1 


1- 


1 


0 


1 


1 




0 


. 1 


* 

1 


0 


1 



1 » mastered 
0 » not mastered 



* Student who learned superordinate skills without learning all 
relevent subordinate skills 
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'Table 9 



Results of Experiment A, Test 3: Showing 
Pass-Fall Pattern on Each 4- earning Set 
In the Hierarchy After Third instructional Book 



4 











Learning Sets 










Student # 


IIIA 


IIIB 


IIIC 


IIA 


IIB 


lie 


IID_ 
/ 

1, 


I 


Empirical 
Sequence 


• 












1 




1 




1 


1 


1 

i 


1 

X 


1 

A 


A 
v 


1 
1 


n 


2 




1 


1 
1 


i 


Ji 


1 
X 


1 

X 


1 

X 


1 

X 




1 


1 


1 


1 


1 


1 

1 


. X 


1 


1 
1 






1 


1 


1 


1 


1 


1 


1 


0 






1 


1 


X 


0 


1 • 


0 


1 


0 


Reo;rder 
Sequence 


•ed 
e 
















1 

• 






1 


' 1 


1 


1 


1 


1 


1 


1 


' 1 




1 


0 


0 


1 


1 


1 


1 


* 

1 


8 




1 


1 


1 


1 


1 


1 


1 


1 


9 




1 


1 


1 


1 


1 


1 


1 


0 


10 




1 


1 


1 


0 


1 


1 


0 


* 

1 



Adequacy Ratio 

IIA IIB lie IID I 
.80 1.00 . 77 .90 .71 

Completness Ratio 

IIA IIB lie . IID I 
1,00 1.00 1.00 1.00 ,71 



(1. 1) 



(1,1)+(0,1) 



(M) 



(1. l)+(0,0) 



1 = mastered 
0 - not mastered 



* Students who learned superordtnatp skills without 
learning all relevant subordinate skills. 



> Table lo 

Individual and Croup M(sm l^rroi* 

Rate In Percent on Instruction 
for Each Level qf the Hierarchy 



Student # 



III 



I^evel 
" ' II 



Empirical Sequence 



1 -» 


00% 


19% 


05% 










2 


00 : 

• 


00 


11 


3 - 


0 

00 


« 

00 


05 


"4 


00 

s 


00 


21 


5 




• 00 


16' 


Means 


"^% 


"04% 


12% 




Reordered 


St'quence 




6 


00% 


06% 


00% 


7 


09 


42 


68 


, 8 


00 


10 


16 


9 


(Did 


not actively 


respond 


10 


00 


39 


29 


Means 

* 


02% 


24% 

•* 


46% 



akilla and two students follow Inn the reonh^n-il siMiuomi' mastorod all 
of the'aklUs. Adequacy ratios of-^.HO. TIA; l.OO, ItH; .77. I JC*, .90. 
Iin; and .71. T; and cotnpletencSR ratios of 1.00. IIA; 1.00, IIH; l.(K), 
TTC; 1.00, IID; and .71, I, compuied form the data from Test HI show 
that the' Instruction under both sequences was orfcn tlvo and complete 
' to the extent indicated. 

Error rates were computed for both groups on instruction for each 
level of learning sets. Individual rates and meani rates are shown 
in Table 10. Contrary to direction, one of the students following 
the reordered sequence did not overtly respond. Examination of the 
rates indicates that the le^ners in the reordered inter-sequence 
group had difficulty learning the skills on levels II and I. 

Hypoth esis 1 . Learners presented with an empitically validated inter- 
sequence take less time on each level of tasks to acquire the terminal 
skill than those learners presented with a reordered inter-sequence. 

Time taken on each level of instruction was examined in Experiment 
A in preference to total time. A multiple measure avoids an "avcraRluR 
effect" which makes no distinction between learners who spend dnrerln}'. 
amounts of time on different levels If their overall times are tlie sam.r. 

"X measurement on each level provides a more ac curate desc ription ol I 
the learning occured. 

Because the multiple measures were taken on the same learners (and 
therefore not independent), a statistical comparison between the em- 
pirical and reordered inter-sequence groups required a multivariate , 
analysis of variance (MANOVA). Table 11 indicates the ^^^^^ivariate 
ratio (Wilk's Lambda) of the within groups variance divided by the t^tal 
variance, as well as the degrees of freedom, and the probability of 
occurrence of the null hypothesis. Univariate tests for each level^te 
also displayed. The testa show no difference between the amount of time 
used by the two groups. / 

Table 11 / 

Multi and Univariate Analysis . ■ 
of Variance for the Factor 
of Inter-sequence 

F DF P . 



1.037 3.45 0.385 



Table 11 (con.) 



Level 



F 



Univariate F 
DF 



P 



III 

II 

I 



0.420 1, 47 
0.074 1, 47 
1.799 1. 47 



0.520 
0.787 
0.186 



A preliminary test of equality of dispersions assumption (analo- 
gous to the homogeneity of variance assximption for MANOVA) was not 
included in the computer- program which computed the test means. How- 
ever,, as Cooley and Lohnes (1971) indicate, "Many research workers 
prefer to ignore the issue of homogeneity of group dispersions on the 
grounds that the test of H2 (test of the difference of means) is 
probably fairly robust under departures from its assumptions (p. 228)." 

A lack of effect on the learning of the groups following the differ- 
ent sequences is also noted in- Table 6. The number and order of books 
taken by each learner is displayed in this table. As mentioned pre- 
viously, if the learner did not mastier the terminal task upon completion 
of Book 3, he was required to continue selecting books to review until 
he could master the termljial task. The results indicate that there is 
essentially no difference in the mean number of books taken by the 
student of the two groups; 4.1 booies for the empirical sequence, and 
4.0 books for the reordered sequence. Also of note is the fact that 
whereas 41.2% of the students receiving an empirical sequence mastered 
the terminal task without review, ^3.6% of the students receiving a 
reordered sequence did so. j 

Hypothesis 2 . Learners following (an empirically validated inter-sequence 
master more skills than those learners following a reordered inter-sequence 



The distribution of skills, ibastered and non-mastered for 
empirical and reordered sequence groups in Experiment B, is shown 
in Table 12. This data was collected after the instruction was 
completed and it Indicates the tdtal number of skills that were mas- 
tered by each student. Of the 40 skills which the students of each 
group received instruction for, 34 were mastered biy the students follow- 
ing an empirical sequence, while 35 were mastered by the students following 
a reordered sequence. A chi-aquare analysis of the number of mastered 
skills is also shown in Table 12. A chi-square value of .104 indicates 
no difference between the number of skills mastered by the" two groups. 

Hypothesis 3 . Of those learners mastering a superordlnate skill, more 
learners also mastered all relevant subordinate skills than will not have 
mastered lower skills. 

For each test of skills at each level in the hierarchy all studcntH 
.aastering any superordlnate skill were examined to see if they .ilso 
mastered all subordinate skills relevant to the. suporordinate skill. 
(See Tables 7, 8, and 9) Of the students wHo mastered superordlnate 
skills, ' Table 13 shows the number. who did or did not also master all 
relevant subordinate skills for each test. iFrequencies for Test 1 do 



Table 12 



Number of Skills Mastered or Not 
Mastered for Learners in Each 
Inter-sequence Group in Experiment B 





1 

Mastered 


Not 

Mastered 


Totals 


Bnpirical 
Sequence 




6 


40 


Reordered 
Sequence 


35 


5 


40 


Totals 


69 


11 


80 



Chi square « 0.104 



not include the dubious mastery of the terminal task by some learners. 
Corrected chi-square values are also displayed for each distribution. 

. . Table 13 

Number of Learners Mastering or Not. 
Mastering Subordinate Skills Who 
Mastered Superordinate Skills 
for Each Test In Experiment B 





Mastered All 

Subordinate 

Skills 


Did Not Master All 

Subordinate 

Skills 


df 


Corrected 
2 

X 


Test 1 


2 


4 


' 1 


0.16 


Test 2 


9 


1 


1 


4.90* 


Test 3 


8 


2 .. 


1 


1.85 



* p < .05 - 

The chi-square value computed for the distribution resulting 
from Test 2 was significant at the .05 level indicating that at tfajis 
point in the learning process more learners mastering superord4^nate 
skills also mastered all relevant subordinate skills. The distribu- 
tion from Tests 1 and 3, however, were not significant. 

It must be noted that of the three points In the learning process 
(Test 1, Test 2, Test 3) that Teat 1 was the crucial test of HypotUesl» 
3. At the point Test 1 was given, learners from the empirical group, 
had received instruction for Level III skills only, while learners 
from the reordered group had had. instruction for Level II skills only.\ 
By the time learners of both groups had taken Test »2 and 3 they had 
received instruction for all subordinate skills (although in different 
orders, of course). Therefore while Test 1 shows whether or not mastery 
of subordinate skills is essential. Test 2 and 3 could just as easily be 
merely testing the accumulation of skills. As indicated in Table 14, 
the distribution for Test 1 fails to sypport the hypothesis. 

Hvpo thesis 4 . Learners presented with an empirically validated Intra^sequen 
take less time on each level of tasks to acquire the terminal skill 
than those learners presented with an inverted intra-sequence. 

''he multivariate test of significance is shown in Table 14 on data 
col .. i>.d from Experiment A. A multivariate F Ratio of 0.666 was not 
slg..' mt. Univariate tests for each level also show a lack of 
lif ferences. There was no difference in the amount of time umul by 
c^tudents following ^pirical or reordered intra-sequenccs to maHt er I he 
terminal task. , . " 



Table 14 



Multi and Univariate Analysis 
of - Variance for the Factor 
of Intra-sequenco 

F DF p 

0.666 37*45 0.577 



Univariate F Tests 
Level F - DF p 

in 07632 TTTt 0.431 

II 1.424 1, 47 0.239 . . 

I b. 036 1. 47 0.851 " 

, Question 1 . Does the order of the inter-sequence have more of an effect on 
time spent on each level of learning set to master the - terminal skill than 
the order of the intra-sequence? 

Since the ordering of neither the inter nor intra-sequence had 
a differential effect on the learning time of the students, no 
statement can be made about the relative effectiveness of these two 
main effects. Question 1 is moot for this experiment. 

Question 2 . Is there an interaction between inter and intra-sequence? 

The test of significance of the Inter-sequence X Intra-sequence 
interaction is shown in Table 15. No interaction resulted from either 
multivariate or univariate tests. Assignment to empirical or reordered 
Inter-sequence had no effect on time for either empirical or inverted 
intra-sequence, and vice versa. 

Table 15 



Multi and Univariate Analysis 
of Variance for the Interaction 
kter X Intra-sequence, 




DF p 

0^79 ar47 oTno" 



Univariate F Tests 
Level F DF p 



III 0.004 1, 47 0.949 
II 0.298 1, 47 0.588 

I 0.053 1, 47 0.818 
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9uoHtlon 3 . Is there an ItUorncllon lu'lwoon oTiIhm IhIim m Im i a-Ho.im'm lniv 
and learning rate? 

An examination of the main effect of learning rate on time to 
mastery of the terminal task, shown In Table 16, indicates a prob- 
ability of less than .064 for the multivariate test. Univariate tests 
for Levels II and I were significant beyond th^/.'05 level. Although 
high learning rate students took less time on Xevels II and I than 'low 
learning rate students, there was no difference between them on the time 
sp6nt on Level III instruction. 

Table 16 

Multi and Univariate Analysis 
of Vaiance for the Factor of 
'Learning Rate 

F DF p 



2.595 



3, 45 



0.064 



Univariate F Tests 
Level F DF 



III 0.944 1, 47 0.336 
II 5.234 1, 47' 0.027 
I 6.066 1, 47 0.017 



Tests of significance for the following are shown in Table 17. 
Inter sequence X Learning Rate, Intra-sequence X Learning Rate, and 
Inter-sequence X Intra-sequence X Learning Rate. None of the Interac- 
tions were significant by eijther multiva'riate or univariate tests. 

Discussion 

N,^^ Concerning the effects of inter-sequencing . Commenting on 

^previous studies on sequencing, Briggs (1968) states that: 

... positive result s, showing that mastery of an early 
skill component does transfer to learning a later one 
is a supporting argument to the notion of hierarchical 
structure when viewed in terms of all the- kinds of 
evidence Gagne presents. On the other hand, negative 
findings , e.g., failure to find transfer from one subtask 
to another, may slroply mean that that task was not 
hierarchical (p. 66) . 
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Table 17 



Multi and Univariate Analysis 
of Variance for the Remaining 
Interactions 

Inter- sequence X Learning Rate 

, F DF P 

( 67945 37^45 0. 427 - 



Univariate F Tests 



Level' F DF p 

-m o^^ 1. 47 cTTsrr 

II 1.992 1, 47 0.172 

II 0.945 1, 47 0.336 ., 



Intra- sequence X Learning Rate 
F DF p 

0.652 3. 45 0.586 



Univariate F Tests 

Level F DF ' p 

— m 0. 342 TTTT 075^ 

II 0.072 1. 47 0.790 

. II 1.678 1. 47 0.202 



Inter X Intra- sequence X Learning Rate 
F DF p 

0.408 3. 45 0.748 



Univariate F Tests 
Level F DF p^ 

m 0. 652 1. 47 0. 424 

II 0.005 1. 47 0.943 

I 0.349 1. 47 0.557 
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Such an argument presumes that the theory concerning hierarchical 
learning is correct and that negative results of an experiment 
designed to test the theory merely indicate that such a test is 
Invalid, this would put the researcher in the untenable position 
of accepting results only if they supported his hypothesis. The 
scientific approach is to presume against the theory until it is 
supported by empirical evidence. A well constructed experiment 
should be presumed to be a valid test of the theory, subject to 
replication. The researcher does not claim immunity from method- 
ological error but is of the position that negative results should 
not be rejected on face value. It remains, therefore, to explain 
why an inter-sequence based on task analysis and empirically val- 
idated according to Walbesser*a technique did not affect learning 
differently than a reordered sequence. 

A source of obvious concern is the learners in Kxperlment B 
(see Table 7) who followed a reordered inter-sequcncc and mastered 
Level II skills without showing mastery of Level TIT skills (students 
#7, 8, 9, and 10). The position of a learner receiving instruction on 
concept rule, tests and feedback on examples and non-examples, but 
not having the attributes identified. 

Bruner, Goodnow & Austin (1957) describe two main strategies 
for attribute identification. In the scanning strategy the subject 
will test a single hypothesis at a time until he hits the correct 
concept. When using the focusing strategy the subject finds a 
positive instance to use as a focus, then makes a sequence of choices, 
each of vAiich alters an attribute value to test whether the change 
yields a positive or negative instance. 

Vlhen asked how he mastered Task IID Student //9 said, "By the pro- 
cess of elimination. By seeing them (examples and corrected responses) 
over and over I could guess what was right." From the student s comment 
it sounds as if he was using the focusing strategy described by Bruner -£t 
al. This nay have been the case with Student #6 who mastered the concept 
^d identified the attributes, but Students //7, 8, 9, and 10 mastered the 
concept without identifying the relevant attributes. 

Whaley and Malott (1971) refer to the case where instances can be 
correctly identified while defining attributes cannot be described 
as "intuitive concepts." They illustrate how such concepts can be 
learned by referring to an experiment by Hernstein and Loveland (1964) . 
In this experiment a straight-forward conditioning procedure was used 
to teach pigeons the complex concept of "man", involving discriminative 
stimulus variety in sex, race, age, and pictorial position and background. 
The stimulus generalization applied as well to instances not used in the 
original conditioning. The procedure used by Hernstein and Loveland 
parallels that used in the instructional materials of this study. 



It appears that by being conditioned with examples and non-example^ 
of the concept so;ae learners were able to show mastery of the concept 
without showing mastery of its defining attributes. However, It is 
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doubtful If the Inatructlon jywr llu' ttncopi rulr wlllunil auv 
AcooinpanylnR examploH, thni tlu* liNtrnors wtnilil Imv»- I.jmii .iM*; to »ori»iilv 
perform on ttie test Itcmwtthoul lliHt pnHHlnv. l In- suhoul tn.»u- .it t rlbut . 
It becomes apparent that the hierarchical depctukMuo In-twoen sots lntoi;u*t: 
with the form in which information is presented in the instruction. What 
is hierarchical using one form of instruction does not seem to be so when 
using another fprm. 

Since this experiment was not designed to test the interaction 
between forms of instruction and hierarchical learning it is suggested 
that such an experiment be designed. Subjects could be divided into 
treatment groups corresponding to a 3x2 factorial using examples/ 
no examples, rule/no rule, and attributes/no attributes. Results 
would indicate effects and interactions of the variables on concept 
■learning. 

Given the data from Experiment B it is possible to interpret the 
lack of differences in time to mastery resulting from the reordering 
the sequence in Experiment A. Level II in a sense stood by itself, 
making the fact that the learners mastered or did not master Level HI 
-irrelevant and thus did not effect time to mastery. If a third group had 
been asked to start with Level I first, it could be expected that they 
would have had great difficulty. One cannot infer from this study 
effect sequencing has on rule using or problem solving since the re- 
ordering involved concept learning only. 

Concerning the effects of intra-sequencing . Each event in the intra- 
sequence of this study was intended to function as a facilitator to the 
corresponding event in information processing of the learner. Pre- 
sumably, however, the information processing occurs somewhat indepen- 
dently of the intended function of the event. Presumably the information 
processing is dependent only on there bein^ information to be processed. 
For example, what was intended by the designer to insure retention in 
the original sequence may function to gain attention in the reordered 
sequence. The requisite for facilitation of learning seems to be. 
what is included in the design rather than what order it is in . 

In commenting on the nine events of instruction Gagne states that, 
"Each of these functions is essential; should any one of them be omitted 
learning would occur only With difficulty '(1970a, p. 320)." A study in- 
volving the deletion of instructional events from an empirically validated 
program may shed more light on the relationship between instructional 
events and learning. Such a study could involve deletion of events or 
combinations of events and examine the resulting effect on learning. 

As for the present study, those learners receiving a reordered intra- 
sequence took no more time on instruction for each level of learning sets 
to master the terminal task than learners receiving an empirical sequence. 
For the hierarchy used the order in which the events of instruction were 
presc^nted had no effect on learning. 
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Concerning the effects of learning rate . Learning rate appeared as a sig- 
nificant factor in two (Levels II, arid I) of the three levels. There 
are two ways that these results can be analyzed. First* the effect of 
learning rate on time to mastery may be influenced by the effectiveness 
of the instruction used. Data from the pilot studies and Experiment A 
indicate that instruction for Level III was the most effective of the 
three instructional books. Also, there was no difference on time to 
mastery between high and low learning i^ate groups on this level. Possibly, 
the more effective the instruction is, the less learning rate will affect 
learning. 

A second analysis of the learning rate data concerns the level of 
type of learning involved. Quito possibly, the a(M"^»ltlon of higher 
types of learning depend increasingly on loarninf* rate Vftjerpaw Lovcl 
III involved discrimination learning. Level h N nml I Involved llu' 
learning of concepts and rules. niHtluctlon boLweon the two an.ilysi'M 
cannot be made from the present study because the lifrectivcnuss o\ llu* 
instruction decreased for higher types of learning. The three factors 
of effectiveness, type of learning, and learning rate should be examined 
separately and in interaction in future studies. 

Summary . Sequencing of learning sets may be dependent in part on the 
type of information presented in the instruction within each level of 
learning set«. That is, for concept learning extensive use of examples 
and corrected responses may in fact make the learning of "subordinate 
skills" unnecessary. Learners seem to be able to go beyond the in- 
formation given to acquire skills not directly intended by the designer. 

The order of instructional events within each learning set does not 
appear to be crucial if all are used. Although the events may be reordered 
in a way that dqjBB not correspond to the manner In which the learner pro- 
cesses the infdirmatlon, t:he learner seems to be ablu to quickly adapt 
the information to the process. 
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